Frames and Finite Dimensionality: 
Frame Transformation, Classification and Algorithms 

Peter Balazs 

Austrian Academy of Sciences, Acoustic Research Institute, Reichsratsstrasse 17,A-1010 Vienna, 

Austria 



Abstract 

In this paper we will look at the connection of frames and finite dimensionality. A main focus is 
to present simple algorithms and make them available online. The main result is a way to 'switch' 
between different frames, giving an algorithm to calculate the coefficients of one frame given the 
analysis of another frame using their cross-Gram matrix. This is a canonical extension of the 
basic transformation matrix used for orthonormal bases (ONB) and is therefore called frame 
transformation. Furthermore we will summarize basic properties of frames in finite dimensional 
spaces. We will give basic algorithms to use with frames in finite dimensional spaces, useful for 
basic numerical experiments. Finally we will give a criteria for finite dimensional spaces using 
frames. 
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1. Introduction 

One mathematical background of today's signal processing algorithms, like mobile 
phone, UMTS, xDSL or digital television, is the concept of frames, which was introduced 
by Duffin and Schaefer [1]. It was made popular by Daubechies [2], and today it is one 
of the most important foundations of Gabor [3], wavelet [4] and sampling theory [5]. In 
signal processing applications frames have received more and more attention [6,7]. 

To be able to work with numerically models, data and operators have to be discretized. 
Application and algorithms always work with finite dimensional data. There are already 
some works investigating frames in finite dimensional setting, for example refer to [8,9]. 
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In the finite dimensional case frames are equivalent to spanning system. Here frames are 
the only feasible generalization of bases, if reconstruction is wanted. In contrast to bases, 
frames loose the linear independence. 

In this paper we will first give a short introduction to the notation of 

frames in Section 2. In Section 3 we will summarize some basic properties of 
frames in finite dimensional spaces. We give MATLAB [10] algorithms to work 
with frames in finite dimensional spaces. Those algorithms arc cither very ba- 
sic and denoted here as single^ code lines. Or they can be downloaded from 
http://www.kfs.oeaw.ac.at/xxl/finitefraimes/finframl.zip. In Section 4 we will 
look at a way to 'switch' between different frames, i.e. find a way to map between their 
coefficient spaces bijcctively and give the algorithm for it. This is done by using the 
Cross-Gram matrix of the two involved frames. It is a canonical extension of the basic 
transformation matrix used for orthonormal bases (ONB), respectively the properties 
of the Gram matrix using a frame and its dual. In Section 5 we finish the look at the 
connection between frames and finite dimensional spaces, by giving a criteria for finite 
dimensional spaces using frames. In particular a space is finite dimensional if and only if 
Efe hkf < oo for any frame (gk). 

2. Preliminaries and Notations : Frames 

The sequence {gk\k G K) is called a frame [1,9,11,12] for the (separable) Hilbert space 
H, if constants A, B > exist, such that 

A-\\ffn<J2\{f,9k)f<B.\\f\\l, yfGH (1) 

fe 

A is called a lower , B a upper frame bound. If the bounds can be chosen such that A = B 
the frame is called tight. Let C : H ^ ^^(^) be the analysis operator C{f) = {{f,gk))- 
Let D : P{K) H he the synthesis operator D {{ck)) = ^Ck ■ gk- Let S : H ^ H he 

k 

the frame operator S{f) = ^ (/, gk) ■ gk- If it is important to note from which frame the 

k 

operator was derived of, we will use an index such as for example as in Cg^, . 

If we have a frame in Ti., we can find an expansion of every member of Ti. with this frame. 

(gk) — [S^^gk) is a frame with frame bounds B~^, A~^ > 0, the so called canonical dual 

frame. Every / e W has the expansions / = E if, 9k) 9k and / = Yl {f,9k)9k where 

fee/f keK 

both sums converge imconditionally in H.. 

For two sequences in Ti. {gk) and (/fe), let the cross-Gram matrix Gg^j^ be given by 
{Ggkjk)jm = dj), j, m€ K.U (gk) = (/fe) we call this matrix the Gram matrix Gg^. 
For frames (fk) the orthogonal projection P from P onto ran{C) is given by G{ck) = 

{{EciS-'fi,f,))^=Gf^^^c. 

2.1. Frames in Finite Dimensional Spaces 

For a very good introduction to the topic of frames in C" refer to [9] Chapter 1. 
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The typical properties of frames can be understood easily in the context of finite- 
dimensional vector spaces. It is well known [9] that the finite sequences that span the 
whole space are exactly the finite frames. 

Let {gk)kLi be a frame in C^. The matrices 



D = 
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describes the synthesis operator D, the analysis operator C and the pseudoinverse . 
Here D : ^ V is defined, such that -Dg^c = D ■ Pi..m(c), where pi..M is the canonical 



projection P ^ C^. Furthermore C : V ^ C P is the matrix such that CgJ = C-f. 



And the pseudoinverse of the synthesis operator is the analysis operator of the dual 
frame. 



3. Working with Frames in Finite Dimensional Spaces 

Here we summarize basic properties needed later, as well as a simple algorithm to 
create frames. 

3.1. Examples of Infinite Frames in a Finite Dimensional Space 

Infinite frames in finite dimensional spaces can also be constructed like in [8]. Let us 

give other examples for this situation, which wc refer to in Section 5. 

(i) Take a basis {ek\k = 1, ..,7V) in and let e^'^ = 1 • for / = 1,2, ... Then (e^'^) 
is a tight frame, as 

„ oo W 

i:|(/.4">| -EE 

k,l 1^1 k^l 

oo ^ N oo ^ 2 

= E ^ E K/' e^)!' = E ^ WfWn = II/IIh • Y 

1=1 Kl fe=i 1=1 r\ 

(ii) The same is possible for e^'^ = |j • for Z = 1, 2, ... This is again a tight frame with 

4 

the bound A= 

3.2. Frames And ONBs 

Frames can be described as images of an orthonormal basis by bounded linear operators 
in an infinite dimensional Hilbert space. They can even be classified by this result: 
Proposition 3.1 Let {ek)kLo ^''^ arbitrary infinite ONB forli.. The frames for H are 
precisely the families {Uck), where U -.H^Hisa bounded and surjective operator. 
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This operator is just the coniposition of an analysis and a synthesis operator. U = 

This proposition seems not very easy to apply for finite dimensional applications at 
the first look, but it is clearly possible: 

Corollary 3.2 Let (efe)^Q be an arbitrary ONB for P. The frames for C are 
precisely the families {Uek), where U : l^ ^ is a surjective operator. 
Proof: Let {fk)kLi be a frame. Define U with 



Uiek) 



fk k<M 
otherwise 



As (eft) is an ONB this operator is well-defined and because (fk) is a frame it is surjective. 
It is clearly bounded. 

On the other hand span (Uek) = U{span{ek)) = U (P) = C'^ . Therefore (Ufk) is a 
frame. □ 

Corollary 3.3 The frames with M elements in C" are exactly the images of an ONB 
in by a surjective operator. 

Proof: In the above proof restrict the ONB to (kerll)'^, which in this case has dimension 
M. □ 

Using this corollary we know that matrices with full column rank correspond exactly to 
frames. 

3.3. Calculation of the Frame Operator 

The frame operator 5 is a n x n matrix S = D ■ D*. This matrix can be represented 

very easily by 

Corollary 3.4 Let [gk) and (7fc) be sequences of elements in H and let Sg^^-y,. be the 
associated frame matrix, then 

{^9k,lu)m,n= \ Y^lk®gk\ =Y^{lk)m-i9k)n 

Proof: S,j = {D^, • C,J. . = E (^tJ^.^ICsJ^j = UlkUWj □ 

k k 

We can also express this term as product of an A/' x 1 and a 1 x A' matrix: 

^9k,Jk = XI 9k -Ik- 
k&K 

So the frame operator matrix can be easily calculated either by multiplying D-D* or 
by using Corollary 3.4. 

Lemma 3.5 Let (gk) and (7^) be frames in with M elements. Regarding numerical 
efficiency we see 

(''■) Sgk,ik = 5fc ■ 7fe needs MN'^ + 3MN - 2N operations and 

keK 



(it) Sg^^yi^ = Dg^ ■ C^^ needs ■ (2M — 1) operations 
This means that the first algorithms is slightly more efficient (for N >A). 

Proof: Using the definition of matrix multiplication, it can be easily seen, that a multipli- 
cation of a M X TV matrix by a iVxP matrix needs M ■P-{2N —\) operations. This gives the 
result for (m). For [i) we have the complex conjugation of a A^-dimcnsional vector, which 
takes N operations. The multiplication of a x 1 matrix by a 1 x matrix, which takes 
N"^ operations. This has to be done M times. Finally M — 1 times the N xN matrices are 
summed, resulting in an overall sum of operations of M ■ i^N + A^^) + (M — 1) • {2N). □ 



3.4. Algorithmic Frame Examples 

As said before a frame can be represented as matrix with full column rank. This is 
just the synthesis matrix, which therefore is an easy way to represent frames. For an 
automatic creation of frames, wc can easily create random frames by creating random 
matrices and checking, if the rank is full. See the file RandFrame . m. This file uses two 
parameter, the dimension of the space, dim and the number of frame elements M. In 
this file also for 2- and 3-dimensional frames the frame elements are plotted ^ . 

The frame bounds of a frame can be easily found by using an algorithm for the singular 
value decomposition, the svd. It is well known [9] that the frame bounds are the smallest 
respectively the biggest eigenvalue of the frame operator 5*. As 5* = DD* , wc get the 
frame bounds by using the square of the maximum and minimum of the svd of D. See 
for example ReindFrame .m. 




270 270 



Fig. 1. Representation of the {rame (left) and its dual (right) of Exam/pie 3.1 (1). 

Example 3.1 : 

(i) As a non-random example let 



3 For 3D plots [13] is used. 
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Di = 



cos(30°) 
sin(30°) 




This is a frame with bounds A = 1.3803, B = 2.6197. See Figure 1. 
(ii) Using dim = 2 and M = 4 in RandFrame . m for example produced the matrix 



Do = 



-0.4205 0.0682 -0.3814 0.1361 
-0.3176 0.4542 0.6770 -0.2592 



This frame has the frame bounds A = 0.313485 and B = 0.864726. See Figure 2. 
(iii) For dim = 3 and M = 5 we got as an example 



-0.9803 -0.6026 -0.6024 -0.1098 -0.1627 
-0.7222 0.2076 -0.9695 0.8636 0.6924 
-0.5945 -0.4556 0.4936 -0.0680 0.0503 



as an example of a frame with 5 elements in M^. It has the frame bounds A = 0.4660 
and B = 2.4484. (For plotting of 3-dimensional frames see PlotSDFrame .m.) See 
Figure 3. 





Fig. 2. Representation of the frame (left) and its dual (right) of Example 3.1 (2). 

The dual frame can be calculated using an algorithm for the pseudoinverse and typing 
Cd = pinv(D), where D is the synthesis matrix of the original frame. 

4. Frame Transformation 

Linear algebra tells us that invertible matrices are exactly describing the transforma- 
tion from one bases to another and unitary operators are exactly representing the change 
between orthonormal bases. So "switching" from one ONB to another is rather straight 
forward. But what about frames? How can a representation be changed from one frame 
to another in the finite dimensional case? 
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Fig. 3. Representation of the frame and its dual of Example 3.1 (3). 

Let {gk)kLi and {fi)iLi be two frames. We want to find a way to switch between the 
coefficients of these frames. We extend a well-known property of the Gram matrix of a 

frame and its dual to arrive at 

Theorem 4.1 Let {gk)kLi o-nd be two frames. The M x N matrix G = Gf.^g^ 

maps ran{Cg^) bijectively onto ran{Cf^) such that 

{{f,9k))k-^{{fJk)), 

and 

M N 

f = E (f'9i)~9i = E ■ i{f^9k))ti)j^ 

i=l i=l * 

Proof: Let c e ran{Cg^.), there exists / G Hi such that Cfe = {f,gk)- Then 

■ c)i = E '^^'1'^'' = E ^^f" -^'^ ■ = ( E 3k) 9k,fi) = {f, fi) ■ 

k k \ k I 

Given c € ran{Cf^) for / = ^ Cfe/fe the element d = (/, gfe) is mapped on c, as 

■ = E ^n,mdm ^^{9m, fn) ' (/, ffm) = 

= </, /n) = E ■ ■^" ) = <^/n,A ■ ^ = ^ 

k 

because c e ran{Cf^) and G^^ is the projection on this space. So this mapping is 
surjective. 

Now suppose G ■ c = G ■ d ior c= {f, gu) and d = {g, gk). This means that 
{f,h)^{g,h)^ f = g^c = d 
and so the mapping is injective and well-defined. □ 

So analogue to the basis transformation matrix defined in linear algebra, the Gram 

matrix G = Gf^^g^can be called the frame transformation matrix 

* This could also be shown using properties of the matrix description of operators using frames [14]. 
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4.1. Examples and Algorithms 



We apply this result on the examples given above. We want to do the frame transfor- 
mation from the frame in Example 3.1 (1) to the one in Example 3.1 (2): 

The cross Gram matrix G = Gf^^g^ can be calculated very easily. As a matrix clearly 

Gmj = {~9j, fm) = (d% ■ D,\ =Dl. {D*J . 

In MATLAB the above (easy) calculation of the Cross-Gram matrix is done in the file 
CrossGram.m: 

G12 = CrossGram(pinv(Dl) ' ,D2) = (D2 ' ) * (pinv(Dl) ' ) ; 
This can be applied on a random vector / to show that the coefficients (/, gi) are 
mapped to (/, fk)- See the file testf rsrnitrajis .m . To test the numerical stability of this 
transformation, this is repeated lOO'OOO times. The maximum error, i.e. the norm of the 
difference of the coefficients with the second frame minus the Gram matrix times the 
coefScients of the first frame, is around 100 • e, where e is the smallest non-zero error 
possible using the given precision. 

This can also be used together with the algorithm RandFrame . m to compare two ran- 
domly created frames. Also in this case it can be nicely seen using the methods above, 
that the error is around the precision error. See testf rcimtrcins2 .m . An exemplary 

output of this algorithm would be: 

Dimension = 8, Number of frame elements, first frame = 19, second frame = 27 
First frame : 

Created a frame with lower bound A = 2.37804 and upper bound B = 11.149 
Second frame: 

Created a frame with lower bound A = 2.75169 and upper bound B = 20.3146 
The maximal error in 100 runs was 2.01704e-014 

5. Classification Of Finite Dimensional Spaces With Frames 

For an ONB (cj) if the sum of the elements ||ei||^ is finite, the dimension of the 

i 

space is finite and vice versa ^ . The Example 3.1 shows that that is not true anymore 
with frames, as in this case 

oo N 

ekii=ee 

l,k 1=1 fe=l 

But taking the square sum of the norms of the elements of a frame for Ti is an equivalent 
condition for Ti being finite dimensional: 

Proposition 5.1 Let {gk) he a frame for the Hilbert space H. Let {ei) be an ONB for 
H. Then the following statements are equivalent 

- Efc llfffcf < 00 

- E; lleill^ < 00 

- the space is finite dimensional. 

^ This is equivalent to the identity being compact. Also this can be extended to the frame case, as it is 
easy to show: The frame operator S is compact if and only if H is finite dimensional. 
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E 

; 1 



N 



oo 



Proof: The equivalence of the second and third statements is clear. 

k k I 

On the one hand, when first sum is finite, the summation can be interchanged and this 
means 

E IIMI' => E E e;>l' > E^ • ll^'ll' 

fc Ik I 

and so the sum ||efe||^ must be finite. 

On the other hand when ||ei|| < oo then J^i 12k \ {fk, < B ■ \\ei\\ and so 
the sum is convergent and the order of the summation can be changed and therefore 

EiiMi'<E^ -He'll 
fc I 

□ 



And as an evident corollaries we find: 
Corollary 5.2 Let (/fe) be a frame and (efe) an ONB for H then 

A-J2\\eif<J2\\fkf<B.J2\\eif 

I k I 

or equivalently (for finite dimensional spaces) 

A ■ dim {H) < ^ ll/fef <B-dim {U) 

k 

Corollary 5.3 Let {fk)k=i ^ tight frame in the finite dimensional H with dirnH = n, 
then 

5]||/fef = A.n reap. LdM^ = A 

k 

If all frame elements have equal length, i.e. ||/fe||-^ = d for all k, then 

m ■ d = A ■ n resp. = A 

If this frame is normalized, i.e. d= 1, then 



A=^ 

n 



Compare to [15], where a possibility to construct such a frame is given. 
6. Algorithms 



All algorithms can be found at 
http : //www. kf s . oeaw. ac . at/xxl/f initef rames/f inf rami .zip 

This includes the files: 



CrossGram.m 
Plot3DFrame.ni 
RandFrame . m 
testf ramtrans .m 
testf ramtraiis2 .m 
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